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Abstract 


The  goal  of  this  research  is  the  development  of  new  fundamental  insights  and  methodologies  to  exploit 
structural  properties  of  large-scale  dynamical  networks  in  order  to  quantify  their  inherent  fundamental  lim¬ 
its  on  performance  and  robustness  and  characterize  their  reuniting  fundamental  tradeoffs.  The  primary  focus 
of  the  project  was  on  revealing  foundational  role  of  underlying  dynamical  structure  and  sparse  information 
structure  of  large-scale  dynamical  networks  in  emergence  of  severe  theoretical  fundamental  limits  on  the  re¬ 
sulting  performance  and  robustness  in  such  networks.  Our  research  results  provide  a  novel  unified  approach 
for  analysis  and  synthesis  of  large-scale  dynamical  network.  We  have  developed  an  axiomatic  general  the¬ 
ory  of  systemic  measures  for  performance  and  robustness  analysis  and  synthesis  of  large-scale  dynamical 
networks.  The  proposed  theory  evolves  around  introducing  the  new  classes  of  convex  and  Schur-convex 
systemic  measures  that  capture  transient,  steady-state,  macroscopic,  and  microscopic  features  of  dynamical 
networks.  The  notion  of  systemic  measure  provides  a  unifying  umbrella  under  which  an  integrated  theory 
of  hard  limits  based  on  operator,  graph,  optimization  theories  can  be  developed  to  systematically  deal  with 
uncertainty,  performance,  and  robustness  in  distributed  control  and  dynamical  systems.  Our  research  re¬ 
sults  are  highly  relevant  for  analysis  and  synthesis  of  engineered  and  natural  dynamical  networks.  In  the 
following  pages,  I  will  briefly  explain  our  theoretical  achievements.  More  details  have  been  provided  for 
selected  number  of  topics.  Proper  citations  to  our  published  papers  have  been  provided  for  further  details 
and  readings. 
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Compressive  Feedback  Control  Design  for  Spatially 

Distributed  Systems 

Summary  of  Accomplishments  and  Research  Results 


1  Systemic  Performance  and  Robustness  Measures 

One  of  the  simplest  elass  of  dynamieal  networks  that  our  proposed  methodology  ean  be  explained  in  a 
simple  setting  is  the  elass  of  first-order  linear  eonsensus  networks  with  the  following  dynamies 


X{t)  =  -Lgx{t)+C{t)  (1) 

y{t)  =  x{t)-x{t)ln  (2) 


where  x{t),y{t)  G  are  the  state  variable  and  output  of  the  dynamieal  network,  respeetively.  The  n  x  1 
veetor  of  all  ones  is  denoted  by  and  x{t)  is  the  average  of  all  state  variables  xi{t), . . .  ,Xn{t).  The 
exogenous  disturbanee  input  eaptures  the  uneertain  effeet  of  the  environment  on  the  dynamies  of  the 
network,  whieh  is  assumed  to  be  a  zero-mean  Gaussian  white  noise  with  unit  eovarianee.  This  dynamieal 
network  is  defined  over  a  graph  Q  =  (y{G),  where  V{Q)  is  fhe  sef  of  nodes  and  E{Q)  is 

fhe  sef  of  edges.  The  weighf  funefion  is  a  map  fhaf  is  defined  from  fhe  sef  of  edges  fo  fhe  sef  of 
sfriefly  posifive  real  numbers  and  if  eapfures  fhe  eoupling  sfruefure  of  fhe  underlying  dynamieal  nefwork. 
The  Laplaeian  mafrix  of  fhe  underlying  graph  of  fhe  nefwork  is  denofed  by  Lg.  The  Laplaeian  mafrix  is 
a  posifive  semidefinife  mafrix  and  ean  be  used  fo  find  many  properties  of  fhe  eorresponding  graph.  The 
(i,  i)  diagonal  elemenf  of  fhe  Laplaeian  mafrix  is  equal  fo  fhe  sum  of  fhe  weighfs  assoeiafed  fo  every  edge 
ineidenf  fo  node  i  and  ifs  {i,j)  off-diagonal  elemenf  is  equal  fo  weigh!  of  edge  eonneefing  nodes  i  and  j, 
ofherwise  if  is  equal  fo  zero.  In  fhe  following  diseussions,  we  assume  fhaf  all  underlying  graphs  are  finile, 
simple,  undireefed  and  eonneefed,  and  Iherefore,  fhe  smallesf  Laplaeian  eigenvalue  is  always  equal  fo  zero. 
Therefore,  fhe  dynamieal  nefwork  (l)-(2)  is  marginally  sfable.  However,  Ibis  nefwork  is  well-defined  and 
ifs  marginally  sfable  mode  is  nol  observable  from  fhe  oufpuf. 

The  linear  dynamieal  nefwork  (l)-(2)  ean  be  viewed  as  a  sysfem  fhaf  has  been  already  sfabilized  by  a 
linear  sfafe  feedbaek  eonfrol  law  and  operafing  in  elosed-loop.  The  sparsity  paffern  of  fhe  Laplaeian  mafrix 
Lg  is  imposed  by  fhe  fopology  of  fhe  underlying  graph  Q  and  fhe  eorresponding  weigh!  funefion,  whieh 
models  fhe  eoupling  sfruefure  and  sfrengfh  among  fhe  subsysfems  in  fhe  elosed-loop  sysfem.  The  exisfenee 
of  sueh  inherenf  sparsify-eonsfrainfs  on  fhe  fopology  of  fhe  underlying  graphs  play  a  foundational  role  in 
emergenee  of  severe  fheorefieal  fundamenfal  limifs  on  fhe  global  performanee  and  robusfness  of  Ibis  elass 
of  dynamieal  nefworks.  We  use  fhe  following  simple  buf  illusfralive  example  fo  eoneepfualize  fhe  idea. 

Example:  Lef  us  index  fhe  Laplaeian  eigenvalues  in  aseending  order  Ai  <  A2  <  •  •  •  <  \n,  where  fhe 
smallesf  eigenvalue  Ai  is  always  equal  fo  zero  for  eonneefed  graphs.  The  sfeady  sfafe  varianee  of  fhe  oufpuf 
of  fhe  nefwork  (l)-(2)  is  an  example  of  a  performanee  and  robusfness  measure.  This  measure  quanfifies  fhe 
expeefed  dispersion  of  fhe  sfafe  of  fhe  nefwork  in  sfafe  sfeady  [1]  and  is  indeed  equal  fo  fhe  ^2-norm  of  fhe 
sysfem  from  fhe  disfurbanee  inpuf  fo  fhe  oufpuf  of  fhe  nefwork  and  ean  be  ealeulafed  in  ferms  of  Laplaeian 
eigenvalues  as  follows 


1 

71 


i=2 


(3) 
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(a) 


Figure  1 :  Among  all  connected  graphs  with  five  nodes,  the  value  of  the  systemic  measure  (3)  is  (a)  maximal  for  a 
path  graph  among  all  graphs  as  well  as  among  all  tree  graphs,  (b)  minimal  for  star  graph  among  all  tree  graphs,  and 
(c)  minimal  for  a  complete  graph  among  all  graphs. 


where  E[ .  ]  is  the  expeeted  value  operator.  Figure  1  shows  a  simple  but  illustrative  example  that  how  measure 
(3)  depends  on  the  topology  of  the  underlying  graph  of  networks.  In  our  results,  we  take  an  axiomatie 
approaeh  to  elassify  several  important  performanee  and  robustness  measures  for  linear  eonsensus  networks. 
Let  us  represent  the  set  of  all  linear  eonsensus  networks  in  the  form  (l)-(2)  that  have  a  eommon  initial 
eondition  xq  by  9d(xo).  Therefore,  every  dynamieal  network  in  9d(xo)  can  be  represented  using  its  Laplaeian 
matrix  using  symbol  AA(Lp). 

Definition!  For  every  given  G  9d(xo),  the  addition  and  scalar  multiplication  operations 

on  Tl(xo)  is  defined  as  follows: 

(i)  N{Lgfi  +  N {Lgf)  =  N {Lg^  +  Lgf) 

(ii)  aM{Lg^ )  =  M{aLg^ )  for  all  positive  scalars  a. 

The  addition  operation  of  two  linear  eonsensus  networks  is  equivalent  to  the  edge  union  operation  on  the 
underlying  graphs  of  the  two  networks.  The  sealar  multiplieation  operation  of  a  linear  eonsensus  network  is 
equivalent  to  sealing  the  weight  funetion  of  the  underlying  graph.  Let  us  denote  Lg  to  be  the  Moore-Penrose 
pseudo-inverse  of  Lg,  whieh  is  a  square,  symmetrie,  doubly-eentered  and  positive  semidefinite  matrix. 

Definition  2  (Convex  Systemic  Measures)  For  a  given  space  of  linear  consensus  networks  Tl(xo),  a  sys¬ 
temic  measure  is  an  operator  p  :  91(xo)  — t  M+  with  the  following  properties: 

(i)  Positive  homogeneity  of  degree —1:  p{Kj\f{Lgfi)  =  p{M  {Lgfj)  for  all  k  >  0, 

(ii)  Monotonicity:  If 

(iii)  Convexity:  p(M{aLg^  +  {l-a)Lgfi)  <  ap{M{Lgfi) +  {l- a)p(M{Lgf,), 
for  all  N{Lgfi,N{Lgf)  G  Tl(xo)  and  all  0  <  a  <  1. 

The  monotonieity  property  implies  that  a  systemie  measure  p  is  subadditive  over  the  set  of  all  linear 
eonsensus  networks.  This  property  ean  be  interpreted  as  a  fundamental  tradeoff  between  systemie  measures 
and  sparsity  of  the  underlying  graph.  If  we  add  more  edges  to  an  existing  graph,  the  value  of  the  systemie 
measure  will  deerease  [26,29].  The  homogeneity  property  implies  that  among  all  graphs  with  identieal 
intereonneetion  topologies,  the  ones  with  larger  (stronger)  eoupling  weights  have  smaller  systemie  measures. 
Zeta  function  based  convex  systemic  measures:  These  important  elass  of  systemie  measures  are  defined 
using  the  spectral  zeta  function  of  Laplaeian  eigenvalues  of  the  underlying  graph  as  follows 

pd^{Lg))  :=  k[Cp{Lg)\K  (4) 
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for  all  1  <  p  <  oo  and  A:  >  0,  where  the  eorresponding  zeta  funetion  of  the  dynamieal  network  (l)-(2)  with 
Laplaeian  eigenvalues  A*  for  i  =  2, . . . ,  n  is  defined  hy 

n 

Cp{Lg)  :=  Tr((4f )  =  (5) 

i=2 

where  Tr(.)  is  the  matrix  traee  operator.  In  our  results,  we  show  that  (4)  is  a  eonvex  systemie  measure 
aeeording  to  Definition  2  that  ineludes  several  well-known  performanee  and  robustness  measures  as  its 
speeial  eases  [26,30].  When  p  — )■  oo  and  k  =  1,  the  systemie  measure  reduees  to  A2  where  A2  is  the 
algebraie  eonneetivity  of  graph  Q.  This  systematie  measure  approximately  measures  the  eonvergenee  time 
of  the  eonsensus  proeess.  For  p  =  1  and  k  =  ^,  the  systemie  measure  (4)  is  equal  to  the  square  of  the 
'H2-norm  of  the  first-order  linear  eonsensus  network  (see  equality  (3)),  and  when  p  =  2  and  k  =  ^,  its 
value  is  equal  to  the  2-norm  of  a  seeond-order  linear  eonsensus  network  [30]. 

Practical  interpretations  of  systemic  measures:  In  [1],  we  show  that  4(2-based  systemie  measures  have 
interesting  physieal  interpretations.  In  a  synehronous  power  grid  subjeet  to  a  random  initial  eondition  (dis- 
turbanee)  ,  the  eorresponding  4(2-based  systemie  measure  is  equal  to  the  total  resistive  power  loss  in  the 
network.  This  implies  that  in  order  to  render  all  states  to  the  eonsensus  state  some  resistive  power  must  be 
wasted  throughout  the  network.  Our  results  show  that  the  least  aehievable  values  of  the  resistive  power  loss 
in  a  power  grid  is  lower  bounded  by  some  eonstants  that  only  depend  on  the  eharaeteristies  of  the  underlying 
graph  of  the  network.  Another  result  in  our  paper  [1]  shows  that  4(2-based  systemie  measure  for  a  group  of 
autonomous  vehieles  partieipating  in  a  formation  is  equal  to  the  total  kinetie  energy  required  to  render  the 
entire  group  to  the  eonsensus  state.  We  are  eurrently  investigating  to  find  praefieal  inferprefafions  of  various 
sysfemie  measures  in  dynamieal  nefworks. 

Remark  1  The  value  of  systemic  measure  (4)  for  isospectral  graphs,  graphs  with  identical  set  of  eigenval¬ 
ues,  are  equal.  This  is  one  of  our  research  thrusts  for  next  year. 

The  eoneepf  of  eonvex  sysfemie  measure  ean  be  exfended  furfher  by  eonsidering  fhe  following  elass  of 
measures  fhaf  are  defined  based  on  notion  of  Sehur-eonvex  funefions. 

Definition  3  (Schur-convex  systemic  measures)  For  a  given  space  of  linear  networks  Tl(xo),  a  schur- 
convex  systemic  measure  is  an  operator  p  :  94(xo)  — ?•  M_|_  that  satisfies  monotonicity  property  (ii)  and 
convexity  property  (Hi)  in  Definition  2  and  is  also  orthogonally  invariant,  i.e., 

p{M{Lg))  =  p{M{ULgU^)), 

for  all  orthogonal  matrices  UU'^  =  U'^U  =  In. 

"^ip-based  Schur-convex  systemic  measures:  For  a  given  linear  consensus  network  N{Lg)  G  Tl(xo), 
suppose  that  G{s)  G  is  the  transfer  function  of  J\f(Lg)  from  disturbance  input  to  its  performance 

output.  Our  research  results  in  [26]  show  that  the  following  class  of  performance  and  robustness  measures 
are  Schur-convex  systemic  measures  according  to  Definition  3: 

/  1  roo  \  1/p 

p«.(v(i5))  :=  iigih,  =  .  (6) 

where  the  Schatten  p-norm  for  every  1  <  p  <  00  is  defined  using  the  singular  values  of  G(jio)  by 
11^0^)11^*  =  Whenp  =  00,  this  systemic  measure  is  equal  to  A2  which  is  in 
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fact  the  input-output  ^oo-norm  of  the  network.  This  measure  can  be  viewed  as  the  maximum  system  gain 
when  inputs  are  taken  over  all  measurable  signals  with  finite  energy.  For  a  given  linear  consensus  network 
M{Lg)  G  9d(xo),  the  ^p-based  systemic  measure  (6)  characterizes  performance  and  robustness  properties 
of  a  network  from  an  input-output  system  theoretic  perspective.  On  the  other  hand,  the  zeta-function-based 
systemic  measure  (4)  can  be  related  to  structural  properties  of  the  underlying  graph  of  the  network  .  Our 
research  results  [26,  30]  show  that  there  is  an  inherent  relationship  between  these  two  class  of  systemic 
measures  and  each  one  can  be  calculated  by  knowing  the  other  one. 

Schur-convex  systemic  measures  generated  by  Schur-convex  sums:  The  second  important  class  of 
Schur-convex  systemic  measures  is  generated  by  sums  of  convex  decreasing  functions  (also  known  as 
Schur-convex  sums)  of  Laplacian  eigenvalues  [26].  Suppose  that  /  :  M+  — )■  M  is  a  decreasing  convex 
function.  For  every  J\f{Lg)  G  Tl(xo),  the  class  of  measures  that  are  defined  by 

n 

PE/(AA(Lg))  =  j;/(A.),  (7) 

i=2 

are  Schur-convex  sysfemic  measure.  For  example,  all  measures  generafed  by  /(A)  =  fall  info  fhis 
cafegory.  This  includes  2-norm  of  fhe  firsl-order  and  second-order  linear  consensus  nefworks  correspond 
fo  convex  funclions  for  p  =  1,2.  Anofher  imporfanf  class  of  Schur-convex  sysfemic  measures  is  fhe  class  of 
enfropy -based  measures  for  linear  consensus  nefworks  fhaf  are  generafed  by  /(A)  =  —  log  A,  which  can  be 
interpreted  as  a  measure  of  uncerfainfy. 

Our  research  resulfs  [26, 30]  show  fhaf  convex  and  Schur-convex  systemic  measures  can  be  related  fo 
fhe  sfrucfural  properties  of  fhe  underlying  graph  of  dynamical  nefworks.  In  some  applications,  if  may  nof  be 
possible  fo  express  explicifly  fhe  corresponding  systemic  measure  in  terms  of  fhe  sfrucfural  properfies  of  fhe 
underlying  graph  of  fhe  nefwork.  Therefore,  we  have  developed  a  novel  mefhodology  fo  obfain  fighf  lower 
and  upper  bounds  for  fhe  class  of  systemic  measures.  In  fhe  following,  some  of  fhe  key  ideas  behind  our 
approach  along  wifh  some  selecfed  resulfs  are  explained. 

1.1  Fundamental  Limits  on  the  Best  Achievable  Systemic  Performance  and  Robustness 

For  a  given  dynamical  network  J\f{Lg)  G  Cti(xo)  with  underlying  unweighted  graph  Q  that  consists  of  n 
nodes,  the  maximal  and  minimal  values  of  the  zeta-function-based  systemic  measure  are  bounded  by 

(A'(Lg))  <  [l  +  (Q  -  diam(6)]  .  (8) 

where  m  is  the  total  number  of  edges,  di  is  the  degree  of  node  i,  and  5a  ■=  X]r=i  df  for  a  =  1,  2.  The 
diameter  of  Q  is  denoted  by  diam(^),  which  is  basically  the  longest  shortest  path  in  the  graph.  This  result 
was  reported  in  [30]  that  shows  explicitly  how  the  value  of  a  systemic  measure  depends  the  microscopic  (e.g., 
degree  nodes)  and  macroscopic  (e.g.,  graph  diameter  and  total  number  of  edges)  features  of  the  underlying 
graph  of  the  network.  According  to  (3),  we  can  quantify  fundamental  limits  on  the  best  achievable  2-norm 
of  a  dynamical  network  with  arbitrary  interconnection  topology  as  follows 

<  P«,(V(Lg))  <  0) 

These  bounds  represent  hard  limits  and  scale  with  the  size  of  the  network.  The  lower  bound  is  achieved 
iff  ^  is  a  complete  graph,  and  the  upper  bound  is  achieved  iff  ^  is  a  path  (chain)  graph.  One  can  extract 
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more  detailed  information  about  performanee  and  robustness  properties  of  dynamieal  networks  by  exploit¬ 
ing  the  speeifie  struetural  properties  of  their  underlying  graphs.  For  instanee,  let  us  eonsider  the  elass  of 
linear  eonsensus  networks  with  at  least  five  nodes  and  tree  intereonneetion  topologies.  The  ^2-norm  sys- 
temie  measure  of  sueh  networks  is  always  worse  (greater)  than  (n  —  1)/ and  always  better  (less)  than 
Y^(r?^^T)7l2.  The  lower  hard  limit  is  aehieved  iff  ^  is  a  star  graph,  and  the  upper  hard  limit  is  aehieved  iff 
0  is  a  path  graph.  These  hard  limits  imply  that  the  ^2-based  systemie  measure  of  linear  eonsensus  networks 
with  tree  struetures  seale  with  0(^/n)  as  n  — )■  oo. 

The  inherent  fundamental  limits  on  performanee  and  robustness  in  dynamieal  networks  ean  also  be 
quantified  in  terms  of  maeroseopie  features  of  the  network,  e.g.,  speetral  properties  of  the  underlying  graph. 
We  explain  one  of  our  interesting  results  by  limiting  our  diseussion  to  the  elass  of  Sehur-eonvex  systemie 
measures  (7)  with  an  additional  assumption  that  /(A)  — )■  OasA  — )■  oo.  For  a  given  dynamieal  network 
G  9d(xo),  we  eonstruet  a  new  dynamieal  network  by  only  adding  at  most  k  new  arbitrary  weighted 
edges  to  the  underlying  weighted  graph.  If  we  denote  the  resulting  network  by  then  there  is  a 

fundamental  limit  on  the  best  aehievable  values  for  the  systemie  measure  of  the  new  dynamieal  network, 
whieh  is  quantified  by 

n 

te;{V(Ly”))  >  y;  /(Af).  (10) 

i=k-\-2 

where  A°*‘*  for  i  =  /c  +  2, ...,  n  are  the  last  n  —  /c  —  1  largest  Laplaeian  eigenvalues  of  the  original  graph  of  the 
network  before  adding  new  edges.  This  result  implies  that  the  performanee  and  robustness  of  a  dynamical 
network  cannot  be  improved  beyond  some  limits  by  increasing  the  connectivity  of  the  underlying  graph. 
The  lower  hard  limit  in  (10)  only  depends  on  some  of  the  Laplaeian  eigenvalues  of  the  original  dynamical 
network  and  is  independent  of  the  weights  of  the  new  edges. 

The  existence  of  hard  limits  in  large-scale  dynamical  networks  motivates  us  to  discover  methodologies 
that  allow  us  to  improve  their  performance  and  robustness  by  optimizing  the  corresponding  systemic  mea¬ 
sures  and  trying  to  reach  the  best  achievable  hard  limits.  In  [6],  we  build  upon  these  notions  and  results  to 
investigate  a  general  form  of  combinatorial  problem  of  growing  a  linear  consensus  network  via  minimizing 
a  given  systemic  performance  measure.  Two  efficient  polynomial-time  approximation  algorithms  are  de¬ 
vised  to  tackle  this  network  synthesis  problem:  a  linearization-based  method  and  a  simple  greedy  algorithm 
based  on  rank-one  updates.  Several  theoretical  fundamental  limits  on  the  best  achievable  performance  for 
the  combinatorial  problem  is  derived  that  assist  us  to  evaluate  optimality  gaps  of  our  proposed  algorithms.  A 
detailed  complexity  analysis  confirms  the  effectiveness  and  viability  of  our  algorithms  to  handle  large-scale 
consensus  networks. 

1.2  Quantification  of  Tradeoffs  Between  Sparsity  and  Systemic  Measures 

The  underlying  dynamical  structure  of  a  network  depends  on  coupling  structure  among  the  subsystems 
which  are  usually  imposed  by  physical  laws  or  global  objectives.  For  example  in  linear  consensus  network 
(l)-(2),  the  Laplaeian  matrix  represents  coupling  structure  in  the  closed-loop  system,  which  is  the  result 
of  sparse  information  structure  in  the  underlying  controller  array.  In  this  research  thrust,  we  focused  on 
revealing  foundational  role  of  sparsity  features  of  the  underlying  graph  of  networks  in  emergence  of  se¬ 
vere  theoretical  fundamental  limits  and  tradeoffs  on  the  resulting  performance  and  robustness  in  large-scale 
dynamical  networks.  Our  goal  was  to  discover  and  quantify  a  variety  of  mathematical  (Heisenberg-like) 
inequalities  explaining  such  fundamental  limits  and  tradeoffs.  In  our  research  results,  we  characterize  the 
inherent  tradeoff  between  some  classes  of  systemic  measures  and  sparsity  features  of  linear  consensus  net¬ 
works  with  unweighted  underlying  graphs.  Let  us  denote  the  adjacency  matrix  of  the  underlying  graph  of 
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network  (l)-(2)  by  Ag.  We  define  the  total  number  of  nonzero  elements  of  the  adjaeeney  matrix,  whieh  is 
denote  by  ||^g||o,  as  our  sparsity  measure.  We  quantify  the  resulting  fundamental  tradeoffs  in  terms  of  this 
sparsity  measure  in  multiplieative  and  additive  forms  by 


PaiLg)  ||Ap||o  > 


(n  —  1)^ 

4 


and 


/2p^^{Lg)-l\ 

\  diam(^)  ) 


+  Pdllo  < 


n{n  —  1) 
2 


where  diam(^)  is  the  diameter  of  the  underlying  graph  and  n  is  the  size  of  the  network.  We  interpret  the 
implieations  of  these  inequalities  by  eonsidering  two  seenarios  for  dynamieal  networks  with  the  same  size. 
The  inequality  in  the  left  asserts  that  the  minimum  (best)  aehievable  levels  of  zeta-based  systemie  measure 
for  sparse  networks  is  higher.  For  all  dynamieal  networks  with  identieal  diameters,  the  inequality  in  the 
right  implies  that  the  maximum  (worst)  aehievable  levels  of  systemie  measures  for  networks  with  more 
edges  is  smaller.  Among  all  networks  with  identieal  number  of  edges,  the  ones  with  larger  diameters  have 
higher  values  of  systemie  measures.  Previously,  we  showed  that  (Lp)  =  py^^{Lg)‘^.  Therefore,  the 
above  fundamental  inequalities  explain  the  quality  of  disturbanee  propagation  in  terms  of  sparsity  features 
of  linear  eonsensus  networks. 

In  [6],  we  extend  this  proposed  methodology  to  broader  elasses  of  systemie  measures.  The  key  idea 
of  our  approaeh  is  based  on  the  monotonieity  property  of  systemie  measures.  This  property  implies  that  by 
improving  eonneetivity  of  the  underlying  graph  the  value  of  systemie  measure  deereases.  We  have  developed 
a  rigorous  mathematieal  framework  to  quantify  the  interplay  between  systemie  measures  and  sparsity  more 
explieitly  using  tight  inequalities.  In  [8,  13],  we  eonsider  general  linear  dynamieal  networks  on  graphs 
(beyond  eonsensus  networks)  and  investigate  various  roles  of  sparsity  in  emergenee  of  fundamental  limits 
and  tradeoffs  on  stability  and  performanee. 


2  Sparsity  and  Spatial  Localization  Measures  for  Distributed  Networks 

The  researeh  results  presented  in  this  seetion  are  pushing  the  known  boundaries  in  spatially  distributed  sys¬ 
tems  towards  new  methodologies  to  study  sparsity  and  spatial  loealization  in  large-seale  dynamieal  network 
in  a  systematie  manner.  The  following  diseussion  is  based  on  our  reeent  work  reported  in  [2]. 

The  omnipresence  class  of  spatially  decaying  systems.  Typical  examples  of  spatially  decaying  systems 
include  linearized  models  of  spatially  distributed  power  networks  with  sparse  interconnection  topologies, 
linearized  models  spatially  distributed  networks  of  autonomous  agents  in  formation,  spatially  discretized 
models  of  infinite-dimensional  systems  with  partial  differential  operators  with  constant  coefficients,  and 
many  more.  In  our  research  results,  we  assume  that  the  underlying  spatial  domain  is  discrete,  i.e.,  G  =  Z 
and  the  state-space  operators  of  system 

ipit)  =  A'4){t)  +  Bu{t),  (11) 

y{t)  =  +  Du{t)  (12) 

are  infinite-dimensional  matrices.  In  order  to  understand  the  asymptotic  behavior  of  localization  techniques, 
we  quantify  spatial  decay  property  by  means  of  coupling  weight  functions.  The  Euclidean  norm  is  denoted 
by  I .  |.  A  positive  nondecreasing  function  u;  on  Z  is  a  weight  function  if  it  satisfies:  w{k)  >  1  and  w{k)  = 
w{—k)  for  all  k  ^  X. 

Definition  4  For  0  <  (7  <  1,  the  coupling  weight  function  w  is  called  admissible  if  there  exist  a  companion 
weight  function  u,  an  exponent  9  £  (0, 1),  and  a  positive  constant  D  such  that 
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(a)  w{k  +  1)  <  w{k)  u{l)  +  u{k)  w{l)  for  all  /c,  /  G  Z, 

(b)  inf  \\ux[-t,t]\\ -  X[-r,r])|L  -  forallt>l. 

T >0  2— g 

The  function  X[-t,t]  is  the  characteristic  function  on  the  interval  [— r,  r].  The  first  condition  implies 
that  w  is  submultiplicative,  i.e.,  w{k  +  1)  <  w{k)  w{l).  Typical  examples  of  admissible  coupling  weight 
functions  that  appear  in  various  applications  are  subexponential  weights  w{k)  =  for  a  >  0  and 

0  <  /3  <  1,  and  polynomial  weights  w{k)  =  (1  +  \k\Y  for  s  >  0.  More  general  weights  are  mixtures  of  the 
form  w{k)  =  (1  +  |A:|)^  ( log(e  +  |/c|))^  for  cj  >  0. 


Definition  5  For  a  fixed  exponent  0  <  g  <  oo  and  admissible  coupling  weight  function  w,  the  class  of 
matrices  5g^^(Z)  consists  of  all  spatially  decaying  matrices  A  =  such  that  A  is  bounded  with 

respect  to  the  matrix  norm 


I5,,„(Z)  :=  maxj  sup 
for  0  <  q  <  CO,  and  by 


iez 


=o.™(z)  :=  sup  \aij\w{i-j). 
i,j&Z 

for  q  =  oo.  In  fact,  the  matrix  norm  (13)  is  a  quasi-norm  for  0  <  (7  <  1. 


(13) 


(14) 


The  matrix  norm  inherits  the  key  submultiplicative  property  from  the  coupling  weight  function,  i.e., 
<  PII5,,»(Z)II-B||5,.™(Z)-  This  property  turns  5g,^(Z)  into  an  interesting  mathematical 
object  so  called  g-Banach  algebra  for  0  <  g  <  1  and  Banach  algebra  for  1  <  g  <  00  that  is  closed 
under  addition  and  multiplication  operations  for  all  0  <  g  <  00,  i.e.,  if  A,B  belong  to  Sq^w{X),  then 
A  -y  B  ^  Sq^w{'^)  and  AB  G  5g,u,(Z).  One  of  the  fundamental  properties  of  the  class  of  spatially 
decaying  matrices  5q^^(Z)  is  that  it  is  inverse-closed  in  (the  Hilbert  space  of  all  bounded  matrices 

on  i.e.,  if  for  every  A  G  Sq^w{h)  that  is  invertible  on  f'^(Z)),  we  have  that  A~^  G  Sq^wC^)  [2]. 

Definition  6  For  a  fixed  0  <  q  <  00,  a  linear  system  (11)-(12)  is  called  spatially  decaying  on  Z  with  respect 
to  an  admissible  coupling  weight  function  w  if  its  state-space  matrices  A,  B,  C,  D  belong  to  Sq^w{^)- 

The  class  of  spatially  decaying  linear  systems  is  closed  under  basic  system  operations  such  as  series, 
parallel,  and  feedback  interconnections. 

Inherent  sparse  information  structure  of  linear-quadratic  regulators  (LQR).  In  our  first  major  result, 
we  consider  the  class  of  spatially  decaying  linear  systems  defined  over  Sq^w{'L)  for  0  <  g  <  00  (Definition 
6).  One  of  fhe  fundamenfal  problems  in  fhe  confexf  of  spafially  disfribufed  systems  is  fo  invesfigafe  sfrucfural 
properfies  of  fhe  linear-quadrafic  regulator  (LQR)  problem  for  spafially  decaying  system  (1 1)-(12)  wifh  cosf 
funcfional 

poo 

J{fo,u)  =  /  [Y* QY  +  u* Ru)  dt.  (15) 

Jo 

Suppose  fhaf  weighf  mafrices  Q  and  R  are  self-adjoinf  and  posifive  definife  and  {A,  B)  is  exponenfially 
sfabilizable  and  {Q,  A)  is  exponenfially  defecfable  in  (fhe  Hilberf  space  of  all  bounded  mafrices 

on  f?^(Z)).  The  LQR  feedback  confrol  law  is  given  by  tt  =  —Kf  =  —R~^B*X'f  where  X  is  fhe  unique 
posifive-definife  solufion  of  fhe  algebraic  Riccafi  equafion 

A*X  -hXA-  XBR-^B*X  +  Q  =  0. 
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(16) 


The  spatial  decay  properties  of  the  quadratically  optimal  controllers  and  filtering  problems  for  spatially 
decaying  systems  are  closely  related  to  the  algebraic  properties  of  the  corresponding  algebraic  Riccati  equa¬ 
tions.  We  have  the  following  fundamental  result  for  the  class  of  spatially  decaying  systems  with  bounded 
operators. 


Theorem  1  ( [2])  For  a  fixed  exponent  0  <  q  <  oo,  suppose  that  A,  B,  Q,  R  belong  to  ,i,(Z).  Then  the 
unique  positive-definite  solution  of  the  algebraic  Riccati  equation  (16)  also  belongs  to  Sq^wCL).  Further¬ 
more,  the  closed-loop  matrix  A  —  R~^B* X  generates  exponentially  stable  semigroup  on  5g,«,(Z). 


The  outcome  of  Theorem  1  states  that  the  LQR  feedback  control  law  K  =  is  spatially 

localized,  i.e., 

\Kij\  <  Cow{i-j)~^  (17) 

where  Co  =  ||iT||5^  ^(2)  is  a  finite  number.  This  implies  that  the  underlying  information  structure  of  the 
optimal  control  law  is  sparse  in  space  and  each  local  controller  needs  to  receive  information  only  from 
some  neighboring  subsystems  (and  not  from  the  entire  spatially  distributed  system).  The  implications  of  our 
results  for  spatially  decaying  systems  lay  foundations  of  a  general  theory  to  discover  fundamental  limits  of 
feedback  control  strategies  in  spatially  distributed  systems  due  to  sparse  information  structures. 

Fundamental  limits  on  best  achievable  degrees  of  spatial  localization.  In  order  to  characterize  a  funda¬ 
mental  limits  on  interplay  between  stability  margins  and  optimal  performance  loss  in  spatially  distributed 
systems,  we  approximate  the  corresponding  LQR  feedback  gain  iT  by  a  sparse  feedback  gain 
a  given  truncation  length  T  >  0  as  follows 


Kij 

0 


if  \i-j\<% 
if  \i-j\>% 


(18) 


By  applying  small-gain  theorem,  we  can  characterize  a  fundamental  limit  in  the  form  of  a  lower  bound  for 
stabilizing  truncation  lengths  for  different  admissible  coupling  weight  functions  [2].  For  the  subexponential 
coupling  weight  function  with  parameters  a  >  0  and  0  <  /?  <  1,  the  sparse  feedback  controller  7^‘^-nearest 
is  exponentially  stabilizing  if  the  truncation  length  T  satisfies  the  following  inequality 


‘2^  >  =  (  -  log  (  ||7f||5,,™(Z)  \\B\\b{P{1))  sup  CJmax(G'(s)))  )  ,  (19) 

yO;  V  Re(s)>0  '  J 

where  G{s)  =  (si  —  (A  -\-  BK))~^  is  the  transfer  function  of  the  closed-loop  system.  A  fundamental 
tradeoff  emerges  between  truncation  length  and  performance  loss.  We  define  the  performance  loss  as  the 
expected  value  of  the  quantity  |  J(xo,  Kx)  —  J{xq,  over  all  random  Gaussian  initial  conditions 

with  zero  mean  and  identity  covariance  matrix.  Our  results  show  that  the  performance  loss  asymptotically 
converges  to  zero  as  T  — )■  oo  [2]. 

Fundamental  tradeoffs  between  sparsity  and  spatial  locality.  Let  us  consider  an  ideal  sparsity  measure 
whose  value  returns  the  maximum  number  of  nonzero  entries  in  all  rows  and  columns  of  a  matrix,  i.e.. 


ll^ll5oi(Z)  :=  max{  sup  ||A:(i,  .)||^o(z),  sup  ||iT(.,  j)||£0(z)  }, 


where  K{i, .)  is  the  i’th  row  and  K{.,j)  the  j’th  column  of  matrix  K.  The  £°(Z)  quasi-norm  of  a  vector  is 
the  cardinality  of  the  set  of  its  nonzero  entries.  The  5o,i-measure  (i.e.,  the  value  of  || .  Q  is  specifically 
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Promotes  sparsity 


Promotes  spatial  localization 


I 


Figure  2:  For  1  <  g  <  oo,  5^  u,(Z)  is  a  Banach  algebra.  However,  5^  ,„(Z)  for  0  <  q  <  1  is  a  quasi-Banach  algebra. 
The  analysis  of  spatially  distributed  systems  which  are  dehned  over  q-Banach  algebras  for  0  <  9  <  1  are  much  more 
subtle  than  those  systems  that  are  dehned  over  Banach  algebras. 


tailored  for  spatially  distributed  systems  as  it  is  a  suitable  measure  for  sparsity  and  spatial  localization  simul¬ 
taneously.  The  5q,«,-measure  (i.e.,  the  value  of  || .  „(z))  of  ^  matrix  can  be  considered  as  an  asymptotic 

approximation  of  its  5o,i-measure,  since  the  following  limit  holds 


lim 

q^O 


11-^1150,1(2)) 


(20) 


for  all  spatially  decaying  matrices  with  bounded  entries.  This  implies  that  the  class  of  spatially  decaying 
matrices  5g,u,(Z)  for  0  <  q  <  1  are  sparse  and  enjoy  certain  interesting  diagonal  decay  properties. 

An  important  fundamental  tradeoff  emerges  when  exponent  q  varies  from  zero  to  infinity.  On  one 
hand,  when  q  tends  to  large  numbers  and  gets  closer  to  00,  the  5^, ^-measure  asymptotically  approximates 
‘5oo,iD-ineasure  and  becomes  an  ideal  spatial  locality  measure.  On  the  other  hand,  when  q  tends  to  small 
numbers  and  gets  closer  to  zero,  the  ^-measure  asymptotically  approximates  5o,i-measure  and  becomes 
an  ideal  sparsity  measure.  We  prove  that  there  exists  an  exponent  q*  <  1  such  that  the  5g,i„(Z)-measure 
approximates  the  ideal  sparsity  measure  5o,i  in  probability  for  all  0  <  g  <  q*.  In  order  to  present  an  explicit 
and  sensible  result,  we  focus  on  the  class  of  exponentially  decaying  random  matrices  of  the  form 


n,,s{z)  =  {  K  = 


\i-j\ 


i,jez 


U(-l,l) 


for  some  given  parameters  a  >  0  and  6  G  (0, 1).  The  coefficients  are  drawn  from  the  continuous 
uniform  distribution  U(— 1, 1).  For  a  given  truncation  threshold  0  <  e  <  1,  the  sparsity  indicator  function 
for  a  random  subexponentially  decaying  matrix  K  G  TZa-^siZ)  is  defined  by 


lATlI 


2  +  1  ’ 


(21) 


where  [.J  is  the  floor  function.  For  proper  values  of  exponent  q  and  parameters  in  the  coupling  weight 
function  w,  the  sparsity  indicator  function  can  take  values  sufficiently  close  to  one.  This  implies  that  ma¬ 
trix  K  G  TZa-^sC^)  can  be  approximated  by  a  sparse  matrix  whose  5o,i-measure  is  close  to  ||A'|||  ^  in 
probability. 


Theorem  2  ( [2])  Consider  the  class  of  matrices  72.ct,5(Z)  and  the  subexponential  coupling  weight  function 
w'  with  parameters  ^  far  some  6  G  (0, 1)  /or  some  p  G  (0, 1).  Let  us  define  parameter  =  g  In  e“^. 
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Then,  for  every  K  G  TZ„^s{'Ij)  we  have 

lim  p|  \^K,w'iq,e)  -  y\  <  eo\  =  1,  (22) 

e-5>0+  I  '  '  J 

for  every  eo  >  0,  where  7'  :=  dt. 

The  result  of  this  theorem  provides  an  algorithm  to  approximate  the  LQR  feedbaek  gain  K  with  a  near- 

optimal  sparse  matrix.  Since  a  and  6  are  known,  we  can  pick  the  positive  parameters  7  and  /3  such  that 

7'  Ri  1,  for  example,  7'  =  0.95.  If  we  fix  parameter  /?,  the  sparsity  indicator  function  becomes  a  single 
variable  function  of  exponent  q  and  its  value  can  be  calculated  for  range  of  parameters  0  <  g  <  1.  Then, 
one  can  calculate  an  exponent  q*  such  that  the  value  of  the  sparsity  indicator  function  stays  arbitrarily 
close  to  7'  for  all  0  <  (7  <  g*.  The  number  WKWi  represents  an  optimal  tradeojfh&t'wt&n  sparsity 

,w' 

and  spatial  localization  measures.  Furthermore,  we  can  extract  more  information  from  exponent  q*  and 
compute  an  optimal  truncation  length  using  the  formula  To  =  ^  By  combining  this  result  with  (19),  a 
near-optimal  stabilizing  truncation  length  for  the  LQR  feedback  gain  is  given  by 

Top  =  max{To,Ts}.  (23) 

Mathematical  foundation  of  notions  of  sparsity  in  spatially  decaying  systems.  The  notion  of  sparsity 
in  spatially  decaying  systems  can  be  generalized  to  more  abstract  ground  via  quasi-Banach  algebras,  which 
is  a  complex  vector  space  of  matrices  .4  on  Z  equipped  with  q-norm  ||  •  ||_4  for  0  <  q  <  1.  The  quasi- 
Banach  algebras  enjoy  similar  basic  properties  to  ^Sq^^(,(Z),  e.g.,  it  is  closed  under  addition  and  multiplication 
operations. 

Definition  7  ( [2])  For  D  <  q  <  a  q-Banach  algebra  A  of  matrices  equipped  with  q-norm  ||  •  ||_4  is 
called  proper  if  it  is:  (i)  closed  under  the  complex  conjugate  operation,  (ii)  a  subalgebra  of  and 

continuously  embedded  with  respect  to  it,  and  (in)  a  differential  Banach  subalgebra  of 

Our  results  show  that  a  proper  (7-Banach  algebra  is  inverse-closed.  This  enable  us  to  define  fhe  class  of 
linear  sysfems  over  proper  (7-Banach  algebra  and  sfudy  fheir  exponenfial  sfabilify.  Moreover,  we  prove  fhaf, 
under  sfandard  assumpfions,  if  fhe  coefficienfs  of  fhe  algebraic  Riccafi  equafion  belong  fo  a  proper  q-Banach 
algebra  A,  fhen  X  G  A. 

2.1  Interplay  Between  Spatial  Localization  Measures  and  Systemic  Measures 

In  our  research  resulfs  [1],  we  show  fhaf  for  fhe  class  of  linear  consensus  nefworks  (l)-(2)  wifh  n  >  3,  fhe 
following  fundamenlal  limif  emerges  befween  fhe  ideal  sparsity  measure  and  zefa  funclion  based  sysfemic 
measures 

Ti  —  1 

\\^g\\so,i  >  (24) 

where  Ag  is  fhe  adjacency  mafrix  of  fhe  underlying  unweighfed  graph  of  fhe  nefwork.  For  nefworks  wifh 
identical  number  of  nodes,  fhis  fundamenlal  Iradeoff  asserfs  fhaf  by  improving  local  connecfivily  in  a  nef- 
work  fhe  minimum  (besf)  achievable  level  of  fhe  sysfemic  measure  decreases. 

The  PI  believes  fhaf  fheses  resulfs  can  be  exlended  lo  quanlify  fundamenlal  Iradeoffs  befween  systemic 
measures  and  fhe  class  of  ^Sq^^^,-measures  for  sparsily  and  spalial  localizalion.  This  is  exlremely  imporlanf 
as  if  will  reveal  several  key  nefwork  design  principles  and  show  fhe  effecls  of  spalial  localization  on  global 
performance  and  robuslness  of  spalially  dislribuled  dynamical  nefworks.  This  objeclive  is  parlicularly  chal¬ 
lenging  as  fhe  class  of  5g^^-measures  for  0  <  q  <  1  are  nonconvex  mafrix  norms  and  require  us  fo  develop 
our  framework  based  on  fools  from  quasi-Banach  algebras. 
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3  Network  Sparsification  with  Guaranteed  Systemic  Performance  Measures 


A  sparse  consensus  network  is  one  whose  number  of  coupling  links  is  proportional  to  its  number  of  sub¬ 
systems.  Optimal  design  problems  for  sparse  consensus  networks  are  more  amenable  to  efficient  optimiza¬ 
tion  algorithms.  More  importantly,  maintaining  such  networks  are  usually  more  cost  effective  due  to  their 
reduced  communication  requirements.  Therefore,  approximating  a  given  dense  consensus  network  by  a 
suitable  sparse  network  is  an  important  analysis  and  synthesis  problem.  In  this  chapter,  we  develop  a  frame¬ 
work  to  produce  a  sparse  approximation  of  a  given  large-scale  network  with  guaranteed  performance  bounds 
using  a  nearly-linear  time  algorithm.  First,  the  existence  of  a  sparse  approximation  of  a  given  network  is 
proven.  Then,  we  present  an  efficient  and  fast  algorithm  for  finding  a  near-optimal  sparse  approximation  of 
a  given  network.  Finally,  several  examples  are  provided  to  support  our  theoretical  developments. 

In  [10,23],  we  specifically  addressed  the  following  network  design  problem:  given  a  linear  consensus 
network  with  an  undirected  connected  underlying  graph,  the  network  sparsification  problem  seeks  to  re¬ 
place  the  coupling  graph  of  the  original  network  with  a  reasonably  sparser  subgraph  so  that  the  behavior  of 
the  original  and  the  sparsified  networks  is  similar  in  an  appropriately  defined  sense.  Such  situations  arise 
frequently  when  real-world  large-scale  dynamical  networks  need  to  be  simulated,  controlled  or  redesigned 
using  efficient  computational  tools  that  are  specifically  tailored  for  optimization  problems  with  sparse  struc¬ 
tures.  We  develop  a  general  methodology  that  computes  sparsifiers  of  a  given  consensus  network  using  a 
nearly-linear  time  0{my  algorithm  with  guaranteed  systemic  performance  bounds,  where  m  is  the  number 
of  links.  Unlike  other  existing  work  on  this  topic  in  the  literature,  our  proposed  framework:  (i)  works  for 
a  broad  class  of  systemic  performance  measures  including  2f2-based  performance  measures,  (ii)  does  not 
involve  any  sort  of  relaxations  such  as  £o  to  £i,  (iii)  provides  guarantees  for  the  existence  of  a  sparse  solu¬ 
tion,  (iv)  can  partially  sparsify  predetermined  portions  of  a  given  network;  and  most  importantly,  (v)  gives 
guaranteed  systemic  performance  certificates. 

While  our  approach  is  relied  on  several  existing  works  in  algebraic  graph  theory,  our  control  theoretic 
contributions  are  threefold.  First,  we  show  that  every  given  linear  consensus  network  has  a  sparsifier  net¬ 
work  such  that  the  two  networks  yield  comparable  performances  with  respect  to  any  systemic  performance 
measure.  Second,  we  develop  a  framework  to  find  a  sparse  approximation  of  large-scale  consensus  net¬ 
works  using  a  fast  randomized  algorithm.  We  note  that  while  the  coupling  graph  of  the  sparsified  network  is 
a  subset  of  the  coupling  graph  of  the  original  network,  the  weights  of  links  (the  strength  of  each  coupling) 
in  the  sparsified  network  are  adjusted  accordingly  to  reach  predetermined  levels  of  systemic  performance. 
Third,  we  prove  that  our  development  can  also  be  applied  for  partial  sparsification  of  large-scale  networks, 
which  means  that  we  can  sparsify  a  prespecified  subgraph  of  the  original  network  to  find  an  approximation 
of  the  network  with  fewer  links.  This  is  practically  plausible  as  our  algorithm  can  be  spatially  localized,  if 
necessary,  and  it  does  not  require  to  receive  information  of  the  entire  coupling  graph  of  the  network. 

We  develop  a  sparsification  framework  for  the  class  of  linear  consensus  networks  governed  by  (1)- 
(2)  that  provides  performance  guarantees  with  respect  to  a  general  class  of  systemic  measures.  First,  we 
introduce  a  notion  of  approximation  for  the  class  of  consensus  networks. 

Definition  8  For  a  fixed  constant  e  G  [0, 1],  a  consensus  network  N{Ls)  is  e-approximation  ofN{L)  if  and 
only  if 

(1-er  <  ^  <  (l  +  ^r,  (25) 

p{Ls) 

for  every  homogenous  convex  systemic  measure  p  :  £n  ^  K-i-  of  order  a  >  0. 

*We  use  0{  )  to  hide  poly  log  log  terms  from  the  asymptotic  hounds.  Thus,  f{n)  €  O  {gin))  means  that  there  exists  fc  >  0 
such  that  f{n)  £  O  {g{n)  log*^  g{n))- 
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Lemma  1  N{Ls)  is  an  e-approximation  ofN{L)  if  and  only  if  the  following  inequalities  hold 

(1  —  e)L  f  Lg  {1  e)L.  (26) 

This  result  is  fundamental  as  it  enables  us  to  take  advantage  of  monotonieity  property  of  systemie  mea¬ 
sures  in  our  approximations. 

Existence  of  e- Approximations:  Among  all  e-approximation  of  a  given  consensus  network  with  a  dense 
coupling  graph,  we  are  interested  in  its  sparsifiers,  i.e.,  those  networks  with  sparse  coupling  graphs. 

Definition  9  M{Ls)  is  a  (e,  d)-sparsifier  of  a  given  network  M  {L)  with  n  nodes  if  the  following  conditions 
hold: 

1.  M{Ls)  is  an  e-approximation  of  network  M  {L) ;  and 

2.  the  coupling  graph  ofN{Ls)  has  at  most  dn/2  links  (i.e.,  feedback  gains). 

The  second  condition  implies  that  the  average  number  of  connected  links  to  nodes  in  the  sparsifier  is  at 
most  d.  In  the  following  theorem,  we  show  existence  of  sparsifiers  for  every  given  consensus  network. 


Theorem  3  Suppose  that  a  consensus  network  M{L)  with  coupling  graph  Q  = 
given.  Then,  there  exists  a  consensus  network  M{Ls)  with  coupling  graph  Qg 
M{Lg)  is  a  2d) -sparsifier  of  Af  (L)  and  Sg  C  S. 


{V,S,w)  and  d  >  1  are 
=  (V,Ss,Ws)  such  that 


Specifically,  Theorem  3  shows  fhat  every  given  linear  consensus  network  with  dynamics  (l)-(2)  has  a 
sparse  consensus  network  such  that  the  two  networks  yield  comparable  performances  with  respect  to  any 
systemic  performance  measure  p  :  £„  — )■  M+. 

In  our  next  result,  we  show  that  every  consensus  network  has  a  sparse  consensus  network  such  that:  (i)  it 
yields  a  better  systemic  performance  than  the  original  network,  and  (ii)  the  total  weight  sum  of  the  coupling 
graph  of  the  sparsifier  is  controlled,  i.e.,  it  is  less  than  a  constant  multiplier  of  that  of  the  original  network. 
For  a  given  coupling  graph  with  Laplacian  matrix  L  and  the  set  of  links  £,  we  denote  the  total  weight  sum 
of  the  coupling  graph  by 

Wtota.i{L)  ■=  ^tu(e).  (27) 

e££ 


Theorem  4  For  a  given  consensus  network  M{L)  with  coupling  graph  Q  =  (V,  E,  w)  and  every  d  >  1, 
there  exists  a  consensus  network N{Lg)  with  coupling  graph  Qg  =  (V,  Eg,  Wg)  that  has  at  most  dn  links  and 
Eg  C  E.  Moreover,  we  have 


Wtotali-Es)  E: 


(  ^fd  -\-  1 
y  \/d  - 1 


2 

Wtotal{L) 


(28) 


and 

p{Lg)  <  p(L), 


for  every  convex  systemic  measure  p  :  £,n  ^  K_|_. 


We  note  that  linear  consensus  networks  with  smaller  systemic  performance  measure  are  more  desirable 
and  they  exhibit  better  network-wide  performance. 

Computing  Sparsifiers  via  Random  Sampling:  We  employ  a  randomized  algorithm  to  compute  a  (e,  d)- 
sparsifier  of  a  given  network.  A  randomized  algorithm  employs  a  degree  of  randomness  as  part  of  its 
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logic.  Randomization  allows  us  to  design  provably  accurate  algorithms  for  problems  that  are  massive  and 
computationally  expensive  or  NP-hard.  According  to  our  discussions  in  [10,23],  we  sample  low-connectivity 
coupling  links  with  high  probability  and  high-connectivity  coupling  links  with  low  probability.  For  a  given 
consensus  network  M{L)  with  n  nodes,  we  sample  links  of  the  coupling  graph  of  this  network  M  times  in 
order  to  produce  a  (e,  2M/n)-sparsifier  of  it.  Let  us  denote  probability  of  selecting  a  link  e  G  £  hy  7r(e) 
that  is  proportional  to  w(e}r(e),  where  w(e)  and  r(e)  are  the  weight  and  the  effective  resistance  of  link 
e,  respectively.  In  each  step  of  sampling,  we  add  the  selected  link  e  to  the  sparsifier  network  with  weight 
w(e} / (M7r(e)).  All  details  of  this  algorithm  is  explained  below: 

Table  1 :  Network  Sparsification  Algorithm 

Algorithm: 

Input:  Q  =  (V,  £^  w) 

1 :  set  Qs  to  be  the  empty  graph  on  V 

2:  for  i  =  1  to  M 

3:  sample  link  e  ^  £  with  probability  7r(e) 

add  it  to  Qs  with  link  weight  w{e) / (M7r(e)) 

4:  endfor 


The  following  theorem  provides  us  with  a  proof  certificate  that  the  above  randomized  algorithm  is  capa¬ 
ble  of  generating  a  sparse  approximation  of  a  given  consensus  network. 

Theorem  5  For  a  given  consensus  network  M {L),  a  fixed  constant  e  G  (1/y^,  1]  and  an  integer  number 
M  =  0(nlogn/e^),  Network  Sparsification  Algorithm  produces  a  {e,2M/n)-sparsifier  of  network  J\f{L) 
with  high  probability^. 

Network  Sparsification  Algorithm  produces  a  sparsifier  with  with  0(nlogn/e^)  links  (i.e.,  feedback 
gains)  in  expectation  and  runs  in  approximately  linear  time  0{m),  where  m  is  the  number  of  links  [10, 23]. 
To  do  so,  good  approximations  of  all  effective  resistances  are  needed,  and  Spielman  and  Srivastava  prove  that 
0(log  n)  calls  to  a  solver  for  symmetric  diagonally  dominant  (SDD)  linear  systems  can  provide  sufficiently 
good  approximations  to  all  effective  resistances. 

4  Performance  and  Robustness  Measure  for  Time-Delay  Networks 

In  [14],  we  investigate  performance  of  noisy  time-delayed  linear  consensus  networks  from  a  graph  topologi¬ 
cal  point  of  view.  Performance  of  the  network  is  measured  by  the  square  of  the  4f2-norm  of  the  system.  The 
focus  of  this  work  is  on  noisy  consensus  networks  with  homogeneous  time  delays  affecting  both  the  agent 
and  all  its  neighbors.  We  derive  an  exact  expression  for  the  performance  measure  of  the  network  in  terms 
of  time  delay  parameter  and  Laplacian  eigenvalues  of  the  underlying  graph  of  the  network.  It  is  shown  that 
the  performance  measure  is  a  convex  and  Schur-convex  function  of  Laplacian  eigenvalues.  We  characterize 
the  network  topology  with  optimal  performance.  Furthermore,  we  quantify  a  fundamental  limit  on  the  best 
achievable  performance  based  on  performance  of  the  optimal  topology. 

In  [11],  we  investigate  topology  design  for  optimal  performance  in  time-delay  noisy  networks.  Per¬ 
formance  of  the  network  is  measured  by  the  square  of  the  system’s  4f2-norm.  Our  focus  was  on  adding 
new  interconnections  to  enhance  performance  of  the  time-delay  first-order  connected  consensus  network. 

^An  event  holds  with  high  probability  if  it  holds  with  probability  1  —  (P(n““)  for  some  a  >  0  independent  of  n. 
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We  discuss  complexity  of  topology  optimization  for  delayed  networks  and  develop  two  practical  methods 
to  tackle  the  combinatorial  eigenvalue  problem  without  exhaustive  search  or  eigen-decomposition.  Further¬ 
more,  we  compare  these  methods  and  discuss  their  degrees  of  optimality.  In  [7],  we  provide  a  comprehensive 
analysis  on  the  effect  of  time-delay  that  reincarnates  itself  in  the  form  of  non-monotonicity,  which  results 
in  nonintuitive  behaviors  of  the  performance  as  a  function  of  graph  topology.  We  present  three  methods  to 
improve  the  performance  by  growing,  re-weighting,  or  sparsifying  the  underlying  graph  of  the  network.  It 
is  shown  that  our  proposed  algorithms  provide  near-optimal  solutions  with  lower  complexity  with  respect  to 
existing  methods  in  literature. 

In  [17],  we  extend  our  focus  and  consider  time-delay  nonlinear  consensus  networks.  We  investigate 
stability  and  convergence  properties  of  a  class  of  nonlinear  delayed  consensus  networks.  Using  tools  and 
techniques  from  functional  differential  equations,  sufficient  stability  conditions  with  respect  to  a  common 
state  as  well  as  estimates  on  the  convergence  rate  are  derived.  We  characterize  the  limit  (consensus)  state  for 
time-invariant  sub-classes  of  these  networks.  More  importantly,  we  specify  under  what  conditions  a  delayed 
network  exhibits  periodic  synchronized  solutions.  We  provide  sufficient  conditions  for  existence,  uniqueness 
and  stability  of  this  interesting  phenomenon.  There  are  several  important  open  problems  remaining  from 
this  effort. 

5  Design  of  Sparse  Feedback  Controllers  for  Spatially  Distributed  Systems 

In  the  following  efforts,  we  implemented  our  theoretical  findings  fo  compufe  sparse  feedback  confrollers 
using  exisfing  opfimizafion  algorifhms. 

5.1  Closed-Loop  Feedback  Sparsification  Under  Parametric  Uncertainties 

In  [15],  we  consider  fhe  problem  of  oufpuf  feedback  confroller  sparsificalion  for  systems  wifh  paramefric 
uncerfainfies.  We  develop  an  opfimizafion  scheme  fhaf  minimizes  fhe  performance  deferiorafion  from  fhaf 
of  a  well-performing  pre-designed  cenfralized  confroller,  while  enhancing  sparsify  pattern  of  fhe  feedback 
gain.  In  order  fo  improve  femporal  proximity  of  fhe  pre-designed  confrol  sysfem  and  ifs  sparsified  counfer- 
parf,  we  also  incorporafe  an  additional  consfrainf  info  fhe  problem  formulalion  such  fhaf  fhe  oufpuf  of  fhe 
confrolled  sysfem  is  enforced  fo  sfay  in  fhe  vicinity  of  fhe  oufpuf  of  fhe  pre-designed  sysfem.  If  is  shown 
fhaf  fhe  resulting  non-convex  opfimizafion  problem  can  be  equivalenfly  reformulated  info  a  rank-consfrained 
problem.  We  fhen  formulate  a  bi-linear  minimizafion  problem  fo  obfain  a  sub-oplimal  solution  which  safis- 
fies  fhe  rank  consfrainf  wifh  arbifrary  tolerance.  Finally,  a  sub-oplimal  sparse  confroller  synfhesis  for  IEEE 
39-bus  New  England  power  nefwork  is  used  to  showcase  fhe  effecliveness  of  our  proposed  mefhod. 

5.2  Periodic  Time-Triggered  Sparse  Linear  Quadratic  Controller  Design 

In  [19],  our  goal  is  fo  achieve  sparsify  in  lime  and  space  simullaneously.  We  invesligale  fhe  periodic  lime- 
Iriggered  sparse  Linear  Quadralic  Confroller  (LQC)  design  for  fhe  class  of  Linear  Time  Invarianl  (LTI) 
systems.  Given  a  lime  period  and  keeping  fhe  confrol  inpul  fixed  during  such  a  time  period,  an  opfimizafion 
problem  is  formulaled  in  which  fhe  objeclive  funclion  consisfs  of  a  quadralic  performance  lerm  along  wifh  an 
f'o-regularizalion  term.  Recasting  such  an  opfimizafion  problem  as  a  rank-consfrained  opfimizafion  problem 
and  utilizing  fhe  weighted  -relaxation  enable  us  fo  apply  so-called  bi-linear  rank  penally  technique  fo 
design  periodic  lime-lriggered  sparse  LQC.  Employing  fhe  various  lesl  cases  and  running  our  proposed 
algorilhm  for  differenl  values  of  time  period,  performance/sparsily  Irade-off  curves  are  visualized  which 
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suggest  a  helpful  criterion  to  choose  the  time  period  in  a  way  that  the  desired  balance  between  controller 
sparsity  and  rate  of  periodic  triggering  is  made. 

5.3  Output  Feedback  Controller  Sparsification  via  ?/2-Approximation 

In  [24],  we  investigate  the  problem  of  optimal  sparse  output  feedback  control  design  for  continuous  lin¬ 
ear  time  invariant  systems.  Unlike  previously  proposed  methods  where  linear  quadratic  regulator  control 
is  modified  to  promote  the  sparsity  level  of  the  controller  gain  matrix,  this  research  adopts  the  concept  of 
^2/^00  control  to  develop  an  optimization  program  capable  of  synthesizing  a  structured  sparse  static  con¬ 
troller  gain  for  which  the  overall  closed  loop  system  exhibits  empirical  frequency  characteristics  resembling 
that  of  the  system  controlled  with  a  pre-designed  centralized  controller.  We,  moreover,  modified  our  opfi- 
mizafion  problem  so  fhaf  fhe  confrol  signal  generafed  by  fhe  sparse  confroller  falls  info  fhe  vicinify  of  fhe 
cenfralized  confrol  inpuf,  in  fhe  sense  of  C\  norm.  Furfhermore,  we  show  fhaf  our  opfimizafion  problem  can 
be  equivalenfly  reformulaled  info  a  rank  consfrained  problem  for  which  we  propose  fo  use  a  version  of  Alfer- 
nafing  Direction  Mefhod  of  Multipliers  (ADMM)  as  a  compufafionally  efficienl  algorifhm  fo  sub-opfimally 
solve  if.  There  are  several  renaming  issues  fo  address  regarding  complexify  of  exisfing  opfimizafion  fools. 

6  Systemic  Performance  Measures  for  Nonlinear  Dynamical  Networks 

6.1  Koopman  Performance  Analysis  of  a  Class  of  Nonlinear  Dynamical  Networks 

In  fhis  research  efforl,  we  aimed  af  exlending  some  of  our  syslemic  measures  resulls  fo  nonlinear  dynamical 
nelworks.  In  [22],  we  build  upon  fhe  Koopman  specfral  analysis  fools  and  develop  a  mefhod  for  assessmenf 
of  fhe  performance  of  a  class  of  firsf-order  nonlinear  consensus  nelworks.  This  class  of  nelworks  is  defined 
over  an  inlerconnecled  graph  wilh  slale-dependenl  weighls  fhaf  are  nonlinear  funclions  of  fhe  slate  of  fhe 
nelwork.  The  mean  energy  of  fhe  oulpul  of  fhe  system  wilh  respecl  fo  random  inilial  condilions  is  ulilized  as 
fhe  performance  measure.  We  quanlify  fhis  performance  measure  in  terms  of  fhe  Koopman  eigenfunclions  of 
fhe  nonlinear  dynamics,  and  fhe  eigenvalues  of  fhe  corresponding  linearized  syslem  al  fhe  equilibrium  of  fhe 
nelwork,  where  fhe  eigenvalues  of  fhe  linearized  syslem  are  indeed  Laplacian  eigenvalues  of  fhe  underlying 
graph  wilh  opposite  sign.  Our  resulls  reveal  fhaf  fhe  performance  measure  of  fhe  nonlinear  nelwork  depends 
on  fhe  inlerconneclion  topology  of  fhe  underlying  graph.  We  have  examined  effecliveness  of  our  resulls 
using  several  case  sludies,  including  a  Cucker-Smale  lype  consensus  nelwork  and  firsf-order  nelwork  of 
identical  Kuramolo  oscillalors. 

6.2  Fundamental  Limits  on  Performance  of  Autocatalytic  Pathways 

I  briefly  oulline  fhe  basics  of  our  mefhod  fo  analyze  aulocalalylic  dynamical  nelworks  [9, 31, 32].  We  will 
consider  Ihree  scenarios.  Firsl,  a  minimal  model  of  an  aulocalalylic  system  is  analyzed.  Then,  a  more 
general  nelwork  topology  wilh  multiple  intermediate  melabolile  reactions  is  considered.  Third,  we  propose 
a  general  model  for  aulocalalylic  nelworks  using  graph  Iheory  tools.  Finally,  we  propose  a  novel  approach 
to  characterize  hard  limils  in  interconnected  nelworks  of  dynamical  systems  using  dualily  concepls.  The 
firsl  step  is  developmenl  of  a  biologically  motivated  minimal  model  of  aulocalalylic  dynamical  nelworks 
lhal  exhibils  fundamenlal  Iradeoffs  caused  by  aulocalalysis.  Analysis  of  robuslness  and  efficiency  Iradeoffs 
for  such  canonical  model  provides  a  deep  underslanding  of  slruclural  properties  of  aulocalalylic  nelworks  as 
well  as  illuslrales  Iheorelical  underpinning  principles  to  design  efficienl  and  robusl  nelworks  of  dynamical 
systems. 
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Minimal  model  of  glycolysis.  The  central  role  of  glycolysis  is  to  consume  glucose  and  produce  adenosine 
triphosphate  (ATP),  the  cells  energy  currency.  Similar  to  many  other  engineered  systems  whose  machinery 
runs  on  its  own  energy  product,  the  glycolysis  reaction  is  autocatalytic.  The  ATP  molecule  contains  three 
phosphate  groups  and  energy  is  stored  in  the  bonds  between  these  phosphate  groups.  Two  molecules  of 
ATP  are  consumed  in  the  early  steps  (hexokinase,  phosphofructokinase/PFK)  and  four  ATPs  are  generated 
as  pyruvate  is  produced.  PFK  is  also  regulated  such  that  it  is  activated  when  the  adenosine  monophosphate 
(AMP)/ ATP  ratio  is  low;  hence  it  is  inhibited  by  high  cellular  ATP  concentration.  This  pattern  of  product 
inhibition  is  common  in  metabolic  pathways. 

Early  experimental  observations  in  Sac- 
charomyces  cerevisiae  suggest  that  there  are 
two  synchronized  pools  of  oscillating  metabo¬ 
lites.  Metabolites  upstream  and  downstream 
of  phosphofructokinase  (PFK)  have  180  de¬ 
grees  phase  difference,  suggesting  that  a  two- 
dimensional  model  incorporating  PFK  dy¬ 
namics  might  capture  some  aspects  of  sys¬ 
tem  dynamics,  and  indeed,  such  simplified 
models  qualitatively  reproduce  the  experimen¬ 
tal  behavior.  We  consider  a  minimal  system 
with  three  reactions  with  a  single  intermedi¬ 
ate  metabolite  reaction  (29)-(31),  for  which 
we  can  identify  specific  mechanisms  bofh  necessary  and  sufficienf  for  oscillafions, 

XI  (29) 

{a  +  l3)y  +  x'^  (30) 

0  (31) 

In  fhe  firsl  reacfion,  s  is  some  precursor  and  source  of  energy  for  fhe  pafhway  wifh  no  dynamics  associafed, 
y  denofes  fhe  producf  of  fhe  pafhway  (ATP),  xi  is  infermediafe  mefabolifes,  x'l  is  one  of  fhe  by-producfs 
of  fhe  second  biochemical  reacfion,  0  is  a  null  sfafe,  a  is  fhe  number  of  y  molecules  fhaf  are  invesfed  in 
the  pathway,  and  a  +  /3  is  the  number  of  y  molecules  produced.  A  B  denotes  a  chemical  reaction 
that  converts  the  chemical  species  A  to  the  chemical  species  B  at  rate  /c.We  choose  f{y)  =  which 

is  consistent  with  biological  intuition  and  experimental  data  in  the  case  of  the  glycolysis  pathway,  where 
V  >  0  depends  on  s,  parameter  q  >  0  captures  the  strength  of  autocatalysis,  and  7,  /i  >  0  capture  the 
strength  of  inhibition.  The  function  /  is  not  monotone  and  captures  the  interplay  between  the  autocatalysis 
and  inhibition.  A  set  of  ordinary  differential  equations  that  govern  the  changes  in  concentrations  xi  and  y 
can  be  written  as 


s  +  ay 

Xl 

y 


Vy^ 

Xl  =  -ka;Xi  +  — - T-  (32) 

1  +  72/ 

aV  y^ 

y  =  -kyy  +  {a  +  P)k:^xi  -  — - (33) 

for  Xl  >  0  and  y  >  0.  To  highlight  fundamental  tradeoffs  due  to  autocatalytic  structure  of  the  system,  we 
normalize  the  concentration  such  that  steady  states  are  y  =  1  and  x  =  . 

Depending  on  values  of  parameters  q  and  h,  the  system  can  have  another  equilibirum  point  which  is 
unstable  when  (x,  y)  is  stable.  Our  model  (32)-(33)  is  a  general  version  of  model  proposed  by  Doyle  et. 
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al..  In  glycolysis  model  (32)-(33),  expression  can  be  interpreted  as  the  regulatory  feedback  control 

employed  by  nature  which  captures  inhibition  of  the  catalyzing  enzyme.  Hence,  we  can  derive  a  control 
system  model  for  glycolysis  as  follows 


X  =  —kxX  +  Vy^u  (34) 

y  =  -kyU  +  {a  +  l3)kxX  -  aVy'^u,  (35) 


where  u  is  the  control  input.  Our  primary  motivation  behind  developing  and  analyzing  such  control  system 
models  for  metabolic  pathways  is  to  rigorously  prove  that  the  tradeoffs  in  such  models  are  truly  unavoidable 
and  independent  of  control  mechanisms  (linear  or  nonlinear)  used  to  regulate  such  pathways.  The  following 
results  assert  that  essential  tradeoffs  depend  only  on  autocatalytic  structure  of  the  network. 


Autocatalytic  Feedback 


Figure  4:  Two-state  model  of  glycolysis. 


Hard  limits  on  ideal  performance.  We  denote 
by  y{t]  u)  the  output  of  the  system  (34)-(35)  with 
respect  to  control  input  u.  For  all  possible  sta¬ 
bilizing  control  inputs  Uo  G  L2([0,cx))),  i.e., 
/o°°  \uo{t)\‘^dt  <  oo,  we  can  prove  that  there  is  a 
hard  limit  on  the  best  achievable  ideal  performance 
of  the  system  which  is  characterized  as  the  follow¬ 


ing  inequality 


f 


{y{t;uo)  -  yYdt  >  H{x{0),y{0);a,  I3), 


(36) 


in  which 

and  2(0)  =  x{0)  +  ^  y(0)  and  z  =  x  +  ^  y.  We  define  rate  of  profit  p  as  the  ratio  of  (3  (net  production 
of  ATP  molecules)  to  a  (number  of  ATP  molecules  invested  in  the  pathway),  i.e.,  p  =  f  ■  The  hard  limit 
function  (37)  can  be  rewritten  as 


F7(x(0),7/(0);/3,p) 


P'^kx 

p{ky  +  pkxY 


(38) 


Fundamental  tradeoff  between  fragility  and  net  production.  When  we  keep  the  rate  of  profit  p  fixed,  a 
fundamental  tradeoff  between  net  production  of  ATP  molecules  and  transient  behavior  of  the  system  emerges 
as  follows:  increasing  /3  can  result  in  undesirable  transient  behavior  (e.g.,  large-magnitude  oscillation  in  the 
output  of  the  system)  and  can  increase  fragility  of  the  network  to  small  disturbances.  For  instance,  if  the 
level  of  ATP  drops  below  some  threshold,  there  will  not  be  sufficient  supply  of  ATP  for  different  pathways 
in  the  cell  and  that  can  result  to  cell  death. 


Autocatalytic  Feedback 


Elimination  of  hard  limits  by  rewiring  the  network. 

We  consider  a  modified  model  of  glycolysis  pafhway 
where  autocatalysis  and  regulating  control  feedbacks  are 
applied  on  different  biochemical  reactions  as  shown  in 
Figure  5.  We  assume  that  the  enzyme  PFK  (the  first  bio¬ 
chemical  reaction  in  Figure  5)  is  not  regulated.  The  main  Figure  5 :  This  topology  results  in  zero  hard  limit, 
motivation  for  deriving  this  model  is  that  ATP  also  in¬ 
hibits  PK  activity  (the  second  biochemical  reaction).  This  is  a  simple  abstract  model  that  shows  how  to 
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eliminate  hard  limits  in  autoeatalytie  networks.  The  set  of  ordinary  differential  equations  governing  the 
ehanges  in  eoneentrations  xi  and  y  is  given  by 

X  =  —kxXU  +  Vy‘^  (39) 

y  =  -kyy  +  {a  +  (5)  kxX  u  -  aVy^ .  (40) 

where  u  is  the  eontrol  input.  We  assume  that  the  desired  equilibrium  point  is  still  (x,  y)  in  order  for  a  fair 
eomparison  between  the  two  models  and  their  eorresponding  hard  limits.  We  ean  prove  that  there  is  no  hard 
limit  on  the  L^-norm  of  the  output  produetion,  i.e., 

{y{t;uo)  -  yY  dt  =  0{e)  (41) 

for  all  stabilizing  state  feedbaek  eontrol  laws  uq  for  system  (39)-(40)  with  uq  G  ^^([0,  oo)).  The  notation 
0{e)  (the  big  O  of  e)  eomes  from  solving  the  eorresponding  eheap  optimal  eontrol  problem.  The  inequality 
(41)  implies  that  the  value  of  integral  ean  be  made  arbitrarily  small  using  eheap  optimal  eontrollers  [9]  and 
that  the  transient  stability  and  performanee  of  the  system  ean  be  improved  arbitrarily  with  no  hard  limit. 

6.3  Synchronization  and  Collision  Avoidance  in  Nonlinear  Dynamical  Networks  of  Agents 

In  [16],  we  introduee  and  diseuss  two  novel  seeond-order  eonsensus  networks  with  state-dependent  eou- 
plings  of  Cueker-Smale  type.  The  first  seheme  models  floeking  to  synehronization  over  a  network  of  agents 
where  the  alignment  of  the  agent’s  states  oeeurs  over  a  non-trivial  limit  orbit  that  is  generated  by  the  internal 
dynamies  of  eaeh  individual  agent.  The  seeond  seheme  models  the  speed  alignment  of  a  group  of  agents 
whieh  avoid  approaehing  eaeh  other  eloser  than  a  preseribed  distanee.  While  seemingly  different,  both  of 
these  systems  ean  be  analyzed  using  the  same  mathematieal  methods.  We  rigorously  analyze  both  examples 
and  reveal  their  striking  similarities.  We  arrive  at  suffieient  eonditions  that  relate  the  initial  eonfigurations 
and  the  systems’  parameters  that  give  rise  to  a  eolleetive  common  behavior.  There  are  several  important 
open  problems  related  to  this  topic. 

In  [18],  we  investigate  the  stability  of  a  class  of  nonlinear  flocking  schemes  of  Cueker-Smale  type  exe¬ 
cuted  on  a  finite  population  of  autonomous  agents.  We  use  algebraic  graph  theory  tools  and  derive  sufficient 
conditions  for  asymptotic  convergence  for  velocity  coordination  while  the  flock  remains  sufficiently  con¬ 
nected.  In  addition,  the  positions  of  the  agents  converge  to  some  predefined  relative  distances. 

7  Centrality  Measures  in  Dynamical  Networks 

7.1  Notions  of  Centrality  in  Consensus  Protocols  with  Structured  Uncertainties 

In  this  research  thrust,  we  explored  how  we  can  utilize  notions  of  systemic  performance  measures  to  identify 
central  nodes  and  couplings  in  large-scale  networks  [5,21].  This  is  particularly  important  for  designing 
robust  dynamical  networks.  In  [5,21],  we  introduced  new  insights  into  the  network  centrality  based  not 
only  on  the  network  topology  but  also  on  the  network  dynamics.  The  focus  of  this  effort  was  on  the  class 
of  uncertain  linear  consensus  networks  in  continuous  time,  where  the  network  uncertainty  is  modeled  by 
structured  additive  Gaussian  white  noise  input  on  the  update  dynamics  of  each  agent.  The  performance  of 
the  network  is  measured  by  the  expected  dispersion  of  its  states  in  steady-state.  This  measure  is  equal  to 
the  square  of  the  4(2-norm  of  the  network,  and  it  quantifies  the  extent  by  which  its  state  is  away  from  the 
consensus  state  in  steady-state.  We  show  that  this  performance  measure  can  be  explicitly  expressed  as  a 
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function  of  the  Laplacian  matrix  of  the  network  and  the  covariance  matrix  of  the  noise  input.  We  investigate 
several  structures  for  the  noise  input  and  provide  engineering  insights  on  how  each  uncertainty  structure 
can  be  relevant  in  real-world  settings.  Then,  a  new  centrality  index  is  defined  to  assess  the  influence  of 
each  agent  or  link  on  the  network  performance.  For  each  noise  structure,  the  value  of  the  centrality  index 
is  calculated  explicitly,  and  it  is  shown  that  how  it  depends  on  the  network  topology  as  well  as  the  noise 
structure.  Our  results  assert  that  agents  or  links  can  be  ranked  according  to  this  centrality  index  and  their 
rank  can  drastically  change  from  the  lowest  to  the  highest,  or  vice  versa,  depending  on  the  noise  structure. 

7.2  Eminence  Grise  Coalitions:  On  the  Shaping  of  Public  Opinion 

in  this  effort,  we  characterize  another  aspect  of  notion  of  centrality  in  time- varying  linear  dynamical  net¬ 
works.  In  [4,21,27,28],  we  have  considered  an  opinion  network  of  multiple  individuals  with  dynamics 
evolving  via  a  general  time-varying  continuous  time  consensus  algorithm.  In  such  a  network,  for  an  arbi¬ 
trary  fixed  initial  time,  a  subset  of  individuals  forms  an  eminence  grise  coalition  (EGC)  if  the  individuals  in 
that  subset  are  capable  of  leading  the  entire  network  to  agreeing  on  any  desired  opinion  through  a  coopera¬ 
tive  choice  of  their  own  initial  opinions.  In  our  research,  the  coalition  members  are  assumed  to  have  access 
to  full  profile  of  the  underlying  graph  of  the  network  as  well  as  the  initial  opinions  of  all  other  individuals. 
We  establish  the  existence  of  a  minimum  size  EGC  and  develop  a  non-trivial  set  of  upper  and  lower  bounds 
on  that  size.  Thus,  even  when  the  underlying  graph  does  not  guarantee  convergence  to  a  global  or  multiple 
consensus,  a  generally  restricted  coalition  of  individuals  can  steer  public  opinion  towards  a  desired  con¬ 
sensus  provided  they  can  cooperatively  adjust  their  own  initial  opinions.  Moreover,  we  provide  geometric 
insights  into  the  structure  of  EGC’s.  Our  results  are  also  extended  to  the  discrete  time  case  where  the  relation 
with  Decomposition-Separation  Theorem  is  also  made  explicit. 

8  Systemic  Risk  and  Fragility  Measures  in  Dynamical  Networks 

We  extended  our  results  to  discover  connections  between  notions  of  risk  and  systemic  performance  and 
robustness  measures.  In  [12],  we  consider  a  few  notions  of  systemic  risk  measures  in  first-order  time- 
invariant  linear  dynamic  networks  steered  by  additive  noise.  We  establish  connections  between  the  risk 
measures,  the  connectivity  properties  of  the  communication  graph  and  eventually  the  performance  measure 
of  these  networks.  Double  inequalities  are  derived  that  bound  the  systemic  risk  measures  in  terms  of  spectral 
properties  of  the  underlying  graph  of  the  network.  We  demonstrate  that  in  an  agreement  seeking  network, 
strengthening  connectivity,  decreases  the  risk  of  systemic  events  up  to  a  lower  limit,  while  in  a  sensor 
placement  protocol,  the  possibility  of  systemic  event  can  increase  proportionally  connectivity-  which  hints 
on  emergence  of  an  intrinsic  interplay  between  risk  and  network  topology. 
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